Top related persons:
Top related locs:
Top related orgs:

Search resuls for: "Patronus"


2 mentions found


"The Perks of Being a Wallflower," "The Fault in Our Stars," "New Moon" — none are safe from copyright infringement by leading artificial intelligence models, according to research released Wednesday by Patronus AI. The company, founded by ex-Meta researchers, specializes in evaluation and testing for large language models — the technology behind generative AI products. Alongside the release of its new tool, CopyrightCatcher, Patronus AI released results of an adversarial test meant to showcase how often four leading AI models respond to user queries using copyrighted text. The four models it tested were OpenAI's GPT-4, Anthropic's Claude 2, Meta's Llama 2 and Mistral AI's Mixtral. Patronus only tested the models using books under copyright protection in the U.S., choosing popular titles from cataloging website Goodreads.
Persons: OpenAI, Anthropic's Claude, AI's, Rebecca Qian, Patronus, Qian, Meta, Gillian Flynn, Bella, Michelle Obama's Organizations: Patronus, Meta, CNBC Locations: Frankfurt, Germany, U.S
Patronus AI co-founders Anand Kannappan and Rebecca Qian Patronus AILarge language models, similar to the one at the heart of ChatGPT, frequently fail to answer questions derived from Securities and Exchange Commission filings, researchers from a startup called Patronus AI found. "That type of performance rate is just absolutely unacceptable," Patronus AI co-founder Anand Kannappan said. It feels like just testing by inspection," Patronus AI co-founder Rebecca Qian said. Here's some examples of questions in the dataset, provided by Patronus AI: Has CVS Health paid dividends to common shareholders in Q2 of FY2022? How the AI models did on the test
Persons: Anand Kannappan, Rebecca Qian Patronus, OpenAI's, ChatGPT, they're, Rebecca Qian, FinanceBench, Qian Organizations: Securities, Exchange, CNBC, SEC, Bloomberg, JPMorgan, McKinsey, Microsoft, Facebook, Meta, Lightspeed Venture Partners, Patronus, CVS, AMD, Coca
Total: 2